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(54) Apparatus and methods tor inserting and detecting electronic watermark 



(57) A secure electronic watermark inserter. A pic- 
ture analyzer 3 analyzes an input picture 101 , and de- 
cides the insertion strength of the electronic water mark- 
ing to be inserted, from one pixel of the input picture 1 01 
to another, to output the insertion strength information 
104 to an electronic watermark pattern inserter 1 and to 
a shifting information pattern inserter 2. The electronic 
watermark pattern inserter 1 inserts an electronic wa- 



termark pattern 1 05, stored in an electronic watermark 
pattern storage unit 4, into the input picture 1 01 . The 
key information pattern inserter 2 inserts the key infor- 
mation pattern 1 06, stored in the key information pattern 
storage unit 5, into a picture to be processed 1 02, having 
the inserted electronic watermark pattern, in accord- 
ance with the insertion strength information 104, to out- 
put the resulting picture. 
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Description 

FIELD OF THE INVENTION 

[0001] This invention relates to an electronic water- 5 
mark inserter, an electronic watermark detector, gener- 
ally, an electronic watermark system, and methods for 
inserting and detecting the electronic watermark em- 
ploying the inserter and the detector. More particularly, 
it relates to a method for preventing the electronic wa- 10 
termark inserted into a picture or image, termed herein 
as "picture" collectively, from being decoded. 

BACKGROUND OF THE INVENTION 

15 

[0002] Up to now, in coping with rapidly increasing uti- 
lization of an electronic medium, such as picture, image 
or multimedia, an electronic watermark is embedded 
electronically into a picture or image for facilitating dis- 
crimination of a data source. 20 
[0003] The furnisher of the electronic medium em- 
beds electronic watermark signals for identifying the fur- 
nisher in the data of the electronic medium it supplies. 
As the electronic watermark signals are detected by the 
software or the hardware, the furnisher proves that is an 25 
owner of the copyright for supervising and managing the 
copyright. 

[0004] The above-described method for inserting and 
extracting the aforementioned electronic watermark is 
disclosed in, for example, the JP Patent Kokai JP-A- 30 
10-145757 or JP Patent Kokai JP-A-10-191330. 

SUMMARY OF THE DISCLOSURE 

[0005] However, there is much to be desired in the 35 
conventional art. 

[0006] The above-described conventional method for 
inserting the electronic watermark suffers a drawback 
that, if the parameters used in inserting the electronic 
watermark into the picture or the image are decoded, 
the electronic watermark inserted into the picture or the 
image may be decoded readily. 
[0007] It is therefore an object of the present invention 
to eliminate the above drawback and to provide an elec- 
tronic watermark inserter and an electronic watermark 
detector which render it possible to improve the secrecy 
of the electronic watermark inserted and methods for in- 
serting and detecting the electronic watermark used in 
the electronic watermark inserter and detector. 
[0008] According to an aspect of the present inven- so 
tion, there is provided an electronic watermark inserter 
for inserting an electronic watermark pattern or patterns 
for identifying a furnisher of a picture or image (termed 
■picture" collectively, herein after) into data of the pic- 
ture, in which the inserter comprises: an electronic wa- 55 
termark pattern inserter for inserting previously gener- 
ated key information pattern or patterns into a picture or 
pictures into which the electronic watermark pattern or 



patterns have been inserted and for transmitting the re- 
sulting picture or pictures. 

[0009] According to a second aspect of the present 
invention, there is provided an electronic watermark de- 
tector for detecting an electronic watermark pattern or 
patterns for specifying a furnisher for a picture inserted 
into data of the picture, in which the detector comprises: 
means for detecting a key information pattern or 
patterns inserted into the data of the picture along with 
an electronic watermark pattern or patterns, means for 
generating parameters required for detecting the elec- 
tronic watermark pattern or patterns from the key infor- 
mation as detected, and means for detecting the elec- 
tronic watermark pattern or patterns from the picture 
based on the parameters generated in the parameter 
generating means. 

[0010] According to the third aspect of the present in- 
vention, there is also provided a method for inserting an 
electronic watermark pattern or patterns for identifying 
afumisher of a picture or pictures into data of the picture 
(s), in which the method includes a step of: providing a 
key information pattern or patterns, a step of inserting 
previously provided key information pattern or patterns 
into a picture or pictures, into which an electronic water- 
mark pattern or patterns have been inserted, and a step 
of transmitting the resulting picture or pictures. 
[0011] According to a fourth aspect of the present in- 
vention, there is further provided a method for detecting 
an electronic watermark pattern for specifying a furnish- 
er for a picture inserted into data of the picture, in which 
the method includes a step of detecting key information 
pattern or patterns inserted into the data of the picture 
or pictures along with the electronic watermark pattern 
or patterns, a step of generating parameters required 
for detecting the electronic watermark pattern or pat- 
terns from the key inf ormation pattern or patterns as de- 
tected, and a step of detecting the electronic watermark 
pattern or patterns from the picture or pictures based on 
the parameters generated. 

[0012] According to a fifth aspect, there is provided 
an electronic watermark system comprising the elec- 
tronic watermark inserter and detector according to the 
foregoing aspects. 

[0013] Thus, the electronic watermark inserter of the 
present invention inserts the key information patterns at 
random coordinates centered about a preset interval in- 
to a picture(s) having an electronic watermark pattern 
(s) inserted therein. 

[0014] On the other hand, the electronic watermark 
detector of the present invention verifies the key infor- 
mation pattem(s), inserted along with the electronic wa- 
termark pattern(s), to generate the electronic watermark 
pattem(s) from the result of the decision. 
[0015] Since this restores the secret key, inserted 
along with the electronic watermark pattem(s), the ci- 
phered electronic watermark pattern (s) can be detected 
to detect the ciphered information inserted in the picture 
(s)- 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0016] 

Fig. 1 is a block diagram showing the structure of 
an electronic watermark inserter according to an 
embodiment of the present invention. 
Fig. 2 shows exemplary key information patterns 
used in the preferred embodiment of the present in- 
vention. 

Fig. 3 is a block diagram showing the structure of 

an electronic watermark detector according to an 

embodiment of the present invention. 

Fig. 4 is a is a block diagram showing the structure 

of a key detector of Fig. 3. 

Fig. 5 is a flowchart for illustrating the processing 

operation of the electronic watermark inserter 

shown in Fig. 1 . 

Fig. 6 is a flowchart for illustrating the processing 
operation of an electronic watermark inserter 
shown in Fig. 3. 

Fig. 7 is a flowchart for illustrating the processing 
operation of the key detector shown in Fig. 4. 

PREFERRED EMBODIMENTS OF THE INVENTION 

[0017] Referring to the drawings, certain preferred 
embodiments of the present invention are explained in 
detail. Fig. 1 is a block diagram showing the structure of 
an electronic watermark inserter. In Fig. 1 , the electronic 
watermark inserter according to the preferred embodi- 
ment of the present invention is made up of an electronic 
watermark pattern inserter 1 , a key information pattern 
inserter 2, a picture analyzer 3, an electronic watermark 
pattern storage unit 4 and a key information pattern stor- 
age unit 5. 

[0018] The picture analyzer 3 analyzes an input pic- 
ture (or image) 101 , such as MPEG (Moving Picture Ex- 
perts Group) data, decides the insertion strength of the 
electronic watermark to be inserted, from one pixel to 
another of the input picture 101 to another, to output the 
insertion strength information 104 to the electronic wa- 
termark pattern inserter 1 and to the key information pat- 
tern inserter 2. 

[001 9] The electronic watermark pattern inserter 1 in- 
serts an electronic watermark pattern 1 05, stored in the 
electronic watermark pattern storage unit 4, into the in- 
put picture 101, in accordance with the insertion 
strength information 104 from the picture analyzer 3, 
and outputs a picture to be processed 102, into which 
has been inserted the electronic watermark pattern, to 
the key information pattern inserter 2. 
[0020] The key information pattern inserter 2 inserts 
key information patterns 106, stored in the key informa- 
tion pattern storage unit 5, into the picture to be proc- 
essed 102, into which the electronic watermark pattern 
has been inserted by the electronic watermark pattern 
inserter 1 , in accordance with the insertion strength in- 



formation 104 from the picture analyzer 3, to output a 
resultant picture processed 1 03, into which has been in- 
serted the key information pattern, to outside. Mean- 
while, the key information pattern inserter 2 inserts the 

5 key information pattern as the patterns each shifted in 
a random direction, respectively. 
[0021] Fig. 2 shows exemplary key information pat- 
terns used in an embodiment of the present invention. 
In Fig. 2, a number of key information patterns (i.e., ref- 

10 erence or prototype original key patterns) are arranged 
at a present interval, as indicated by solid-line blocks in 
Fig. 2. The respective patterns are shifted in respective 
random directions, when the key information patterns 
are inserted by the key information pattern inserter 2 into 

15 the picture to be processed 102, into which has been 
inserted the electronic watermark patterns, as indicated 
by broken line blocks shown in Fig. 2. 
[0022] Fig. 3 shows a block diagram showing the 
structure of the electronic watermark detector according 

20 to an embodiment of the present invention. In Fig. 3, the 
electronic watermark detector according to the instant 
embodiment of the present invention is made up of a 
key detector 6, a cipher decoder 7 and an electronic wa- 
termark detector 8. 

25 [0023] The key detector 6 detects the key information, 
inserted following the insertion of the electronic water- 
mark pattem(s), from an input picture 201 , to output the 
key information 202 detected, and the input picture 201 , 
to the cipher decoder 7. In this case, the key detector 6 

30 outputs the input picture 201 straightforwardly to the ci- 
pher decoder 7. 

[0024] The cipher decoder 7 generates parameters 
required by the electronic watermark detector 8, based 
on the input picture 201 and the key information 202, to 

35 output the so-generated parameters and the input pic- 
ture 201 to the electronic watermark detector 8. In this 
case, the cipher decoder 7 outputs the input picture 201 
straightforwardly to the electronic watermark detector 8. 
[0025] The electronic watermark detector 8 detects 

40 the electronic watermark patterns, inserted into the input 
picture 201 , based on the parameters 203, which are 
required for electronic watermark detection, and which 
are generated by the cipher decoder 7, to output detect- 
ed results 204 to outside. 

45 [0026] Fig. 4 is a block diagram showing the structure 
ofthe key detector 6. In Fig. 4, the key detector 6 is made 
up of a block slicer 61 , an inner product unit 62, a max- 
imum inner product value decision unit 63, a search 
range end decision unit 64, a key information generator 

so 65, a coordinate calculating unit 66, a key information 
pattern storage unit 67 and a maximum inner product 
buffering unit 68. 

[0027] The block slicer 61 slices one block 301 of the 
input picture 201 , with a coordinate 307 obtained by the 
55 coordinate calculating unit 66, to output the so-sliced 
block 301 to the inner product unit 62. The inner product 
unit 62 finds an inner product of the sliced block 301 
from the block slicer 61 and the key information pattern 
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stored in the key information pattern storage unit 67 to 
output a result of the inner product 302 to the maximum 
inner product value decision unit 63. 
[0028] The maximum inner product value detection 
unit 63 compares the result of the inner product 302 from 
the inner product unit 62 to the information 311 in the 
maximum inner product buffering unit 68. If the result 
shows that the inner product 302 is larger, the maximum 
inner product value detection unit 63 outputs the result 
of the inner product 302 and a coordinate 307 obtained 
from the coordinate calculating unit 66, that is the coor- 
dinate of the sliced-out block, to the search range end 
decision unit 64, as a decision result 303, while substi- 
tuting a result of the inner product 304 for a correspond- 
ing value of the maximum inner product buffer in the 
maximum inner product buffering unit 68. It should be 
noted that the maximum inner product buffering unit 68 
is made up of a number of maximum inner product value 
buffers #1 to #n corresponding to the number of key in- 
formation pattern insertion positions (see Fig. 2). 
[0029] When fed with an end signal 309 indicating the 
end of the block slicing of a preset range from the coor- 
dinate calculating unit 66, the search range end decision 
unit 64 outputs an end signal 305 to an enlargement/ 
contraction rate decision unit 65. If the block slicing for 
a preset range is not finished, the search range end de- 
cision unit 64 outputs a command signal 306 for causi ng 
the coordinate calculating unit 66 to issue the next block 
si icing-out coordinate. 

[0030] When fed with the end signal 305 from the 
search range end decision unit 64, the key information 
generator 65 is fed with the information 312 in the max- 
imum inner product buffering unit 68 to generate the key 
information in the maximum inner product buffering unit 
68 to output the key information 202 to the cipher de- 
coder 7. 

[0031 ] From the coordinates, by which the key infor- 
mation patterns have been inserted, the coordinate cal- 
culating unit 66 outputs coordinates 307, 308, shifted in 
+X, +Y, - X and -Y directions, respectively. The coordi- 
nate calculating unit 66 also outputs a number of coor- 
dinates 307, 308 with the number being equal to the 
number of the inserted key information patterns. 
[0032] Figs. 5, 6 and 7 are flowcharts showing the 
processing operations of the electronic watermark in- 
serter, shown in Fig. 1, an electronic watermark detec- 
tor, shown in Fig. 3, and the key detector 6, shown in 
Fig. 4, respectively. Referring to Figs. 1 to 7, the method 
for inserting the electronic watermark and the method 
for detecting the electronic watermark, according to an 
embodiment of the present invention, are now ex- 
plained. 

[0033] The picture analyzer 3 analyzes an input pic- 
ture 101 (or an image) to decide the insertion strength 
of the electronic watermark to be inserted, from one pix- 
el of the input picture to the next, to output the insertion 
strength information 104 to the electronic watermark 
pattern inserter 1 and to the key information pattern in- 



serter 2 (step 1 in Fig. 5). 

[0034] The electronic watermark pattern inserter 1 in- 
serts an electronic watermark pattern 1 05, stored in the 
electronic watermark pattern storage unit 4, into the in- 

5 put picture 101, in accordance with the insertion 
strength information 1 04 from the picture analyzer 3, to 
output a picture to be processed 102, into which has 
been inserted the electronic watermark pattern or pat- 
terns, to the key information pattern inserter 2 (step S2 

10 of Fig. 5). 

[0035] The key information pattern inserter 2 inserts 
a key information pattern 106, stored in the key informa- 
tion pattern storage unit 5, into the picture to be proc- 
essed 1 02, into which the electronic watermark pattern 

is has been inserted by the electronic watermark pattern 
inserter 1 (step S3 in Fig. 5), to output the processed 
picture 103, into which has been inserted the lay infor- 
mation pattern, to outside (step S4 in Fig. 5). 
[0036] The key detector 6 detects the key information 

20 of the input picture 201 , enlarged/contracted following 
insertion of the electronic watermark pattern, based on 
the key information pattem(s) inserted into the input pic- 
ture 201 , to output the key information 202 and the input 
picture 201 to the cipher decoder 7. In this case, the key 

25 detector 6 outputs the input picture 201 straightforward- 
ly to the cipher decoder 7 (step S11 of Fig. 6). 
[0037] That is, the block slicer (sectioner) 61 in the 
key detector 6 slices out (sections out) one block (sec- 
tion or pixel) of the input picture 201 with the coordinate 

30 306 obtained from the coordinate calculating unit 66, to 
output the so-sliced out block to the inner product unit 
62 (step S21 of Fig. 7). 

[0038] The inner product unit 62 finds the inner prod- 
uct of the sliced-out block 301 from the block slicer 61 

35 and the key information pattern stored in the key infor- 
mation pattern storage unit 67 to output the result of the 
inner product 302 to the maximum inner product value 
detection unit 63 (step S22 of Fig. 7). 
[0039] The maximum inner product value detection 

40 unit 63 compares the result of the in ner product 302 from 
the inner product unit 62 to the information 311 in the 
maximum inner product buffering unit 68 (step S23 in 
Fig. 7). If it is the result of the inner product 302 that is 
larger (step S24 of Fig. 7), the maximum inner product 

45 value detection unit 63 outputs the result of the inner 
product 302 and the coordinate 307 obtained from the 
coordinate calculating unit 66 (coordinate of the sliced- 
out block) as being the result of the inner product 303 
to the search range end decision unit 64. The maximum 

so inner product value detection unit 63 also substitutes the 
result of the inner product 304 for the corresponding val- 
ue in the maximum inner product value in the maximum 
inner product buffering unit 68 (step S25 in Fig. 7). 
[0040] If the result of the inner product 302 is smaller 

55 (step 24 in Fig. 7), the maximum inner product value de- 
tection unit 63 outputs the result of the inner product 302 
and the coordinate 307 obtained from the coordinate 
calculating unit 66 (the coordinate of the sliced-out 
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block) as being the result of decision 303 to the search 
range end decision unit 64. 

[0041 ] If the si icing out of the block of the preset range 
is not completed (step S26 of Fig. 7), the search range 
end decision unit 64 outputs a command signal 306 for 
causing the coordinate calculating unit 66 to output the 
next block slicing-out coordinate (step S27 of Fig. 7). 
[0042] When fed with an end signal 309, indicating the 
end of slicing out of the block of the preset range from 
the coordinate calculating unit 66 (step S26 of Fig. 7), 
the search range end decision unit 64 outputs an end 
signal 305 to the key information generator 65 (step S28 
of Fig. 7). 

[0043] When fed from the end signal 305 from the 
search range end decision unit 64, the key information 
generator 65 is fed with the information 312 in the max- 
imum inner product buffering unit 68 to generate the key 
information from the coordinate in the maximum inner 
product buffering unit 68 (step S29 in Fig. 7) to output 
the key information 202 to the cipher decoder 7 (step 
S30 in Fig. 7). 

[0044] The cipher decoder 7 generates parameters 
required by the electronic watermark detector 8, based 
on the input picture 201 and on the key information 202 
from the key detector 6 to output the so-generated pa- 
rameters 203 and the input picture 201 to the electronic 
watermark detector 8 (step S12 of Fig. 6). In this case, 
the cipher decoder 7 outputs the input picture 201 
straightforwardly to the electronic watermark detector 8. 
[0045] Based on the parameters 203, required for 
electronic watermark detection, generated by the cipher 
decoder 7, the electronic watermark detector 8 detects 
the electronic watermark pattern or patterns inserted in- 
to the input picture 201 (step S13 of Fig. 6) to output the 
result of detection 204 to outside (step S14 of Fig. 6). 
[0046] By inserting the electronic watermark pattern 
105 to the input picture (or pictures) 101 , and by then 
inserting into the picture or pictures the key information 
patterns 106, arrayed at a preset interval, and which 
when inserted are shifted in random directions, the elec- 
tronic watermark positions are randomized, thus im- 
proving the secrecy of the inserted electronic water 
marking. 

[0047] Moreover, by detecting the key information 
pattern inserted with the electronic watermark pattern, 
generating the parameters necessary for detecting the 
electronic watermark pattern from the so-detected key 
information pattern and by detecting the electronic wa- 
termark based on the so-generated parameters, it is 
possible to improve the secrecy of the inserted electron- 
ic water marking data. 

[0048] By adding these processing operations to the 
former half and to the latter half of the electronic water- 
mark inserter not coped with by (or not compatible with) 
the key information, it is possible to improve the secrecy 
of the inserted electronic watermark data. 
[0049] The meritorious effects of the present inven- 
tion are summarized as follows. 



[0050] According to the electronic watermark inserter 
of the present invention, in which, in the electronic wa- 
termark inserter for inserting the electronic watermark 
pattern for specifying the furnisher of the picture or im- 

5 age to data of the picture or image, the key information 
pattern, prepared at the outset, is inserted into the pic- 
ture or image, into which has been inserted the electron- 
ic watermark pattern (s), and the resulting picture or im- 
age is transmitted, it is possible to improve the secrecy 

10 of the inserted electronic watermark data. 

[0051] Moreover, according to the electronic water- 
mark detector of the present invention, in which, in the 
electronic watermark detectorf or detecting the electron- 
ic watermark pattern (s) used for specifyingthe furnisher 

f5 of the picture or image, inserted into the picture or im- 
age, the key information pattern, inserted into the data 
of the picture or image, along with the electronic water- 
mark pattern, is detected, the parameters required in de- 
tecting the electronic watermark pattern from the detect- 

20 ed key inf ormation are generated, and the electronic wa- 
termark patterns are detected from the picture or image 
based on the so-generated parameters, it is possible to 
improve the secrecy of the inserted electronic water- 
mark data. 

25 [0052] It should be noted that other objects, features 
and aspects of the present invention will become appar- 
ent in the entire disclosure and that modifications may 
be done without departing the gist and scope of the 
present invention as disclosed herein and claimed as 

30 appended herewith. 

[0053] Also it should be noted that any combination 
of the disclosed and/or claimed elements, matters and/ 
or items may fall under the modifications aforemen- 
tioned. 

35 

Claims 

1. An electronic watermark inserter for inserting an 
40 electronic watermark pattern or patterns for identi- 
fying a furnisher of a picture or image, termed "pic- 
ture" collectively, into data of said picture, said in- 
serter comprising: 

an electronic watermark pattern inserter for 
45 inserting previously generated key information pat- 
tern or patterns into a picture or pictures into which 
said electronic watermark pattern or patterns have 
been inserted and for transmitting the resulting pic- 
ture or pictures. 

50 

2. The electronic watermark inserter as defined in 
claim 1 wherein said key information patterns are 
arranged at preset intervals, and wherein, when in- 
serted, said key information patterns are shifted in 

55 respective random directions. 

3. The electronic watermark inserter as defined in 
claim 1 or 2 further comprising: 
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picture analysis means for analyzing an input 
picture for determining the insertion strength of 
said electronic watermark pattern into each pix- 
el of said picture; 

said electronic watermark pattern or patterns 
and said key information patterns being insert- 
ed in accordance with said insertion strength 
information. 

4. An electronic watermark detector for detecting an 
electronic watermark pattern or patterns for speci- 
fying a furnisher for a picture or image, termed "pic- 
ture" collectively, inserted into data of said picture, 
comprising: 

means for detecting a key information pattern 
or patterns inserted into said data of the picture 
along with an electronic watermark pattern or 
patterns; 

means for generating parameters required for 
detecting the electronic watermark pattern or 
patterns from the key information as detected; 
and 

means for detecting said electronic watermark 
pattern or patterns from said picture based on 
the parameters generated in said parameter 
generating means. 

5. The electronic watermark detector as defined in 
claim 4 wherein the key information patterns are 
patterns that are arranged at a preset interval at the 
outset and that, when inserted, are shifted each in 
a random direction. 

6. An electronic watermark system comprising the 
electronic watermark inserter according to claim 2 
or 3 and the electronic watermark detector accord- 
ing to daim 4 or 5. 

7. A method for inserting an electronic watermark pat- 
tern or patterns for identifying a furnisher of a picture 
or image, termed "picture" collectively, into data of 
said picture, said method comprising the steps of: 

(a) providing a key information pattern or pat- 
terns, 

(b) inserting the previously provided key infor- 
mation pattern or patterns into a picture or pic- 
tures, into which an electronic watermark pat- 
tern or patterns have been inserted, and 

(c) transmitting the resulting picture or pictures. 

8. The method as defined in claim 6 wherein said key 
information patterns are arranged at preset inter- 
vals, and wherein, when inserted, said key informa- 
tion patterns are shifted in random directions, pat- 
tern by pattern. 



9. The method as defined in claim 7 or 8 further com- 
prising: 

a step of analyzing an input picture or pictures 
5 for determining the insertion strength of said 

electronic watermark pattern or patterns per 
each pixel or section of said picture or pictures; 
a step of inserting said electronic watermark 
pattern or patterns and said key information 
io pattern or patterns in accordance with said in- 

sertion strength information. 

1 0. A method for detecting an electronic watermark pat- 
tern for specifying a furnisher for a picture or image, 

is termed "picture" collectively, inserted into data of 
said picture, comprising the steps of: 

(a) detecting key information pattern or pat- 
terns inserted into said data of the picture or 
pictures along with said electronic watermark 
pattern or patterns; 

(b) generating parameters required for detect- 
ing the electronic watermark pattern or patterns 
from the key information pattern or patterns as 
detected; and 

(c) detecting said electronic watermark pattern 
or patterns from said picture or pictures based 
on the parameters generated. 

1 1 . The method as defined in claim 1 0 wherein said key 
information patterns are patterns that are arranged 
at a preset interval at the outset and that, when in- 
serted, are shifted in a random direction, pattern by 
pattern. 

12. A computer program comprising computer program 
code for causing a computer to execute a method 
according to any of claims 7 to 11 . 
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START 



ANALYZE AN INPUT PICTURE TO DECIDE THE STRENGTH OF 
INSERTION OF ELECTRONIC WATERMARK INSERTED FROM 
ONE PIXEL OF THE INPUT PICTURE TO THE NEXT 
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